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EVALUATION  OF  C*  CENTERS 


1.0  INTRODUCTION 


This  report  documents  the  efforts  of  Decisions  and  Designs 
Inc.  ( DDI )  toward  the  development  of  a  general  model  for  the 
evaluation  of  proposed  and  existing  Command  and  Control  centers 
Such  a  model  is  desirable  in  and  of  itself  and,  in  addition, 
can  serve  as  a  stepping  stone  in  the  evolution  of  a  science  or 
theory  of  Command  and  Control . 

2 

The  task  of  building  a  general  evaluation  model  for  C 
centers  is  complicated  by  the  large  number  and  variety  of  sys¬ 
tems  designed  for  the  gathering,  transmission,  and  analysis  of 
information;  specific  systems  used  for  these  purposes  vary 

with  branches  of  the  U.S.  services  and  NATO  as  well  as  with 
2 

the  levels  of  C  centers  in  the  overall  command  structure. 

The  approach  that  DDI  proposed  to  use  in  building  the  general 
model  included: 

(1)  developing  specific  resource  allocation  models  for 

2 

several  C  centers  chosen  to  represent  different 
branches  and  levels  of  the  command  structure; 

(2)  analyzing  these  specific  models  for  commonality;  and 

(3)  extracting  general  principles  which  could  be  embodied 

2 

in  a  generic  C  evaluation  model  and  could  form  the 
foundation  of  a  science  of  command  and  control 
center  design. 
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To  enable  DDI  personnel  to  perform  efficiently  the  first 

of  the  tasks  listed  above,  a  series  of  conferences  was  held 

with  Air  Force,  Army,  and  Navy  C  experts.  During  these 

meetings,  in  which  preliminary  specific  models  were  built,  it 

became  apparent  to  the  DDI  personnel  involved  in  the  project 

that  the  goals  of  the  effort  could  be  better  served  by  using  a 

"top-down"  modelling  approach  rather  than  the  proposed  "bottom- 

up'*  approach.  The  "top-down"  approach  develops  a  general 

2  2 
evaluation  model  for  C  centers,  by  dimensionalizing  C  needs 

and  requirements  at  a  fairly  abstract  level  and  then  decom¬ 
posing  these  relatively  few  abstractly  stated  requirements 
into  concrete  criteria  against  which  systems  can  be  evaluated. 
The  "bottom-up"  approach  begins  with  the  host  of  past,  present, 
and  planned  systems,  determines  the  functions  that  they  serve, 

and  attempts  to  abstract  from  these  functions  evaluation 

2 

criteria  which  can  be  related  appropriately  to  C  requirements. 

2 

The  information  gathered  in  the  conferences  with  C 

experts  was  used  to  create  the  structure  of  a  hierarchical 

2 

evaluation  model  for  C  information  capabilities.  This  struc¬ 
ture,  when  augmented  with  weights  which  reflect  the  relative 

importances  of  the  evaluation  criteria  included,  can  be  used 

2 

as  is  in  the  evaluation  of  C  center  information  capability,  or 

2 

it  can  serve  as  a  foundation  for  more  specific  C  evaluation 
models. 

Section  2.0  summarizes  the  meetings  attended  by  DDI 

2 

personnel  and  Air  Force,  Army,  and  Navy  C  experts.  Section 

3.0  contains  the  general  hierarchical  model  for  the  evaluation 

2 

of  C  information  capabilities. 
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2.0  CONFERENCES  WITH  COMMAND  AND  CONTROL  EXPERTS 


DDI  personnel  met  with  C  experts  to  gather  information 
about  and  build  preliminary  resource  allocation  models  for 
different  types  of  C  centers. 

The  implementation  of  DDI's  resource  allocation  approach 
requires  the  steps  described  below. 

1.  Identify  Variables  to  Which  Resources  Can  Be  Allo¬ 
cated.  Variables  over  which  resources  must  be 
distributed  are  identified.  An  attempt  is  made  to 
characterize  the  problem  by  using  variables  that  can 
be  independently  manipulated;  that  is,  differing 
levels  of  resources  can  be  allocated  independently 
to  each  of  the  variables. 

2.  Identify  Levels  of  the  Variables  that  Vary  from 
"Austere"  to  "Gold-Plated. "  The  "austere"  level 
involves  a  minimal  resource  allocation  with  minimal 
benefit.  The  "gold  plated"  level  involves  maximal 
resource  allocation  with,  hopefully,  maximal  benefit. 
The  levels  of  the  variables  from  austere  to  gold 
involve  increasing  commitments  of  resources,  which 
usually  result  in  an  increased  level  of  benefit  to 
the  organization. 

3.  Assess  Costs.  A  cost  is  assigned  to  each  level  of 
each  variable  such  that  the  first  level  is  the  least 
expensive  level,  successive  levels  are  increasingly 
more  expensive,  and  the  last  level  is  the  most 
expensive  level  on  that  variable. 


4. 


Assess  Benefits  (Intra-Variable).  The  levels  of 
each  variable  are  assigned  scores  to  reflect  their 
relative  benefit.  Since  incremental  benefit  is 
being  considered,  the  minimum  level  is  assigned  a 
score  of  0  and  the  highest  level  is  assigned  a  score 
of  100.  Intermediate  levels  are  assigned  values  by 
comparing  their  improvement  over  the  minimum  level 
relative  to  the  total  improvement  from  the  minimum 
to  the  highest  level. 

5 .  Assess  Importance  Weights  (Inter-Variable  Benefits). 
The  variables  are  given  importance  weights  by  having 
the  decision  maker(s)  assess  the  relative  improvement 
or  benefit  of  going  from  "austere"  to  "gold"  on  each 
of  the  variables.  This  step  rescales  the  100-point 
benefit  ranges  associated  with  each  variable  onto  a 
common  benefit  scale  by  directly  comparing  the 
benefits  associated  with  these  100-point  ranges. 

For  example,  one  variable  may  be  assessed  to  have 
200  points  associated  with  its  austere-to-gold 
range,  while  another  variable  has  100  points  associ¬ 
ated  with  its  austere-to-gold  range.  This  indicates 
that  the  increase  in  benefit  from  austere  to  gold 
for  the  former  variable  is  twice  as  great  as  the 
improvement  for  the  latter.  The  calculated  relative 
benefit  value  for  any  level  of  a  variable  is  propor¬ 
tional  to  the  weight  of  the  variable  multiplied  by 
the  score  on  that  level. 

In  the  Air  Force  and  Army  meetings,  C*  variables  were 
identified  along  with  the  systems  which  constitute  the  austere 
and  gold-plated  levels  of  these  variables;  skeleton  DESIGN 
models  composed  of  this  information  are  included  in  the  sum¬ 
maries  which  follow. 
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2 . 1  Summary  of  Conference  with  General  Richard  R.  Stewart 

The  focus  of  the  meeting  was  information  :  its  gathering, 
flow,  processing,  and  use  for  achieving  objectives. 

Figure  2-1  shows  an  information-flow  diagram  for  command 
and  control.  The  diagram  serves  as  an  aid  in  building  a 
qualitative  model  of  C* ;  a  preliminary  version  of  the  quali¬ 
tative  model,  including  three  air  missions,  is  shown  in  Table 
2-1. 

The  next  stage  in  the  modelling  effort  is  the  organiza¬ 
tion  requirements  and  capabilities  in  such  a  way  that  current 
and  planned  C  systems  can  be  evaluated  quantitatively.  This 
phase  was  begun  with  the  identification  of  three  information 
variables  of  C  systems:  DATA-RED,  DATA-BLUE,  and  COMMUNICA¬ 
TIONS/DISPLAYS  .  In  some  cases,  it  is  necessary  to  include 

ANALYSES  as  well  as  a  variable.  Tables  2-2,  2-3,  and  2-4  show 
2 

the  skeleton  C  DESIGN  model  structures  for  three  Air  Force 
Missions. 

2 . 2  Summary  of  Conference  with  General  John  R.  Deane,  Jr. 

After  the  initial  modelling  meeting,  in  which  General 

2 

Stewart  served  as  an  Air  Force  C  expert  in  order  to  develop 

design  models  for  various  air  missions,  a  meeting  was  held  in 

2 

which  General  Deane  aided  in  model-building  for  Army  C  mis¬ 
sions. 

The  work  began  with,  an  effort  to  build  design  models 
similar  to  those  previously  built  for  air  missions.  General 
Deane  determined  that  the  structure  and  variables  of  such 
models  would  be  identical  for  the  three  missions,  Defend  in 
Place,  Defend-Successive  Lives,  and  Attack;  thus,  only  one 
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Table  2-1 

QUALITATIVE  MODEL  OF  THREE  A/F  MISSIONS 


COMM/DISPLAY 


Ai r  Warning 

Comm 

Line 

Remote 

Scope 

Air  Fields 

Tel ephone 

Continuous 

Digital 

Display 

Pilots 

Through 

Air  Field 

Direct  Digital 

Intel  1 igence 

NSA  only 

Comm  Lines 

Land  Line 
w/  limited 

RF 

Red 

Database 

LOS  Radars 

A/F 

A/C 

No  Pilot 
p(T/oK3 
p(cross 
border)*. 95 
NSA  Listening 
AWACS 

OTH  Radars 

Al 1  Wx  Satel 1 i te 
Sensor 

A/F 

A/C 

A/C  Status 

Munitions 

POL 

Manua 1  TTY 

Digital 

Network 

w/  RSI  6 

Automated 

Logistics 

System 

Table  2-2 

SKELETON  DESIGN  MODEL  FOR  AIR  DEFENSE 
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8000 

.1000  w/In  20  mi. 

. 1000  w/In  6  hrs. 
.1000  w/ln  12  hrs. 
.5000  w/in  21*  hrs. 


Table  2-3 

SKELETON  DESIGN  MODEL  FOR 
INTERDICTION  AND  AIR  SUPERIORITY 
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Manual 

Updates 

Dtgital 

Updates 

RED 

DATA 

BASE 

COMM/ 

Radio 

Wide  band 

DSPY 

TTY 

capacity  to 

DASC  for 
photos,  maps 

Table  2-4 

SKELETON  DESIGN  MODEL  FOR  CLOSE  AIR  SUPPORT 
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DESIGN  model  was  necessary.  In  building  the  Army  model,  two 

new  variables,  Environment  and  Survivability,  were  added  to 

the  list,  comprised  of  Comms,  Blue  Data  Base,  and  Red  Data 

Base,  used  in  all  of  the  Air  Force  models.  Some  question 

arose  as  to  the  appropriate  place  in  the  model  of  Information 

Management/Analysis,  and  it  was  decided  that  this  variable 

would  be  subsumed  under  the  categories  of  information  to  be 

managed  and  analyzed.  Table  2-5  shows  the  DESIGN  model  devel- 
2 

oped  for  Army  C  ;  the  leftmost  column  contains  information 
about  functions  for  the  variables,  and  the  entities  to  the 
right  are  tools  used  to  achieve  these  functions. 

After  the  DESIGN  model  displayed  in  Table  2-5  had  been 
built,  the  variables  listed  for  C  and  Surveillance/Fusion  in 
the  DIV  86  Blueprint  of  the  Battlefield  were  classified  ac¬ 
cording  to  their  relationships  to  the  variables  in  the  model 
currently  under  discussion.  This  classification  was  under¬ 
taken  with  an  eye  towards  using  the  DIV  86  variables  in  a 
future  iteration  of  the  current  model;  the  taxonomy  is  shown 
in  Figure  2-2. 

2 . 3  Summary  of  Conference  with  Admiral  William  H.  McLaughlin 

2 

Admiral  McLaughlin  began  by  defining  C  as  a  commander 

(1)  making  a  decision, 

(2)  issuing  a  directive,  and 

(3)  controlling  the  execution 

in  a  dynamic,  uncertain  environment;  he  pointed  out  that  the 
executor  of  a  directive  is  also  a  decision  maker,  often  per¬ 
forming  the  three  tasks  listed  above.  The  dynamic,  uncertain 
nature  of  the  environment  induces  the  need  for  a  complete 
communication  loop,  as  the  commander  must,  besides  conveying 
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information  in  the  form  of  orders,  receive  current  information 
for  decision  making. 

The  Admiral  pointed  out  that,  for  modelling  purposes,  the 
2 

appropriate  C  context  is  that  of  a  general  war,  with  the  goal 
of  winning.  As  in  the  Army  and  Air  Force  sessions,  the  emphasis 
in  this  session  was  on  information  variables;  however,  rather 
than  classifying  C  systems  and  equipment  according  to  the 
types  of  information  to  which  thev  are  relevant,  the  types  of 
information  were  measured  al'rng  various  dimensions  for  a 
specific  command,  the  Carrier  Task  Force.  The  resulting 
matrix  is  shown  in  Table  2~tj  similar  matrices  could  be  devel¬ 
oped  for  other  commands. 


age/  method  of 

DYNAMIC  STATIC  TIMELINESS  ORIGIN  PRIORITIZATION  HANDLING  DISTRIBUTION 


Table  2-6  (Cont'd) 

INFORMATIONAL  REQUIREMENTS— CARRIER  TASK  FORCE 


3.0  A  HIERARCHICAL  EVALUATION  MODEL  AND  CONCLUSIONS 


The  information  gathered  in  conferences  with  C  experts 

was  used  to  structure  a  Multi-Attribute  Utility  Analysis 

.  2 

(MAUA)  model  for  the  evaluation  of  C  information  capabili¬ 
ties.  MAUA  is  a  structured,  logically  defensible  approach  to 
the  evaluation  of  entities  which  vary  along  more  than  one 
dimension.  A  MAUA  model  is  hierarchical  in  nature,  starting 
with  the  specified  top-level  factor  for  which  an  overall  score 
is  desired.  This  factor  is  successively  decomposed  into 
subfactors  in  descending  levels  of  the  hierarchy  such  that 
each  successive  level  is  more  specific  than  the  one  preceding 
it.  At  the  lowest  level  of  the  hierarchy  are  predictable  or 
observable  characteristics  of  the  system  under  evaluation. 

Figures  3-1  through  3-4  show  the  hierarchy  built  for  the 
2  2 
evaluation  of  C  information  capabilities.  C  INFORMATION  is 

broken  down  into  DATA  and  COMMUNICATIONS;  DATA  is  divided  into 
BLUE,  RED,  and  ENVIRONMENT,  each  of  which  is  further  subdi¬ 
vided,  and  so  on. 

3.1  Importance  Weights 

To  implement  the  model,  it  is  necessary  to  obtain  weights 
which  reflect  the  relative  importance  of  the  evaluation  cri¬ 
teria. 


Two  approaches  to  assigning  weights  are  generally  used  in 
MAUA.  One  is  a  "top-down"  approach,  which  begins  at  the  top 
of  a  hierarchy,  first  establishing  the  relative  importance 
between  factors  (level  1),  between  subfactors  (level  2),  and 
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HIERARCHICAL  EVALUATION  MODEL  FOR 
C2  INFORMATION  CAPABILITIES  -  ENVIRONMENT  DATA 
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than  COMMUNICATIONS.  Within  DATA  (i.e.,  level  2),  one  asks  if 

•  BLUE  DATA  is  more,  equally,  or  less  important  than  RED  DATA  or 
ENVIRONMENT  DATA.  The  same  approach  is  followed  throughout 
the  hierarchy.  The  relative  weights  assigned  to  the  factors 
or  elements  that  comprise  each  level  of  the  hierarchy  are 

*  normalized  to  sum  to  1.0  (or  100)  at  that  level  of  the  hierarchy. 

The  second  approach,  referred  to  as  the  "bottom-up" 

approach,  first  establishes  the  most  important  of  the  sub- 

$  elements,  e.g.,  within  ENVIRONMENT  DATA  in  our  own  hierarchy. 

This  can  be  accomplished  by  asking  questions  about  the  relative 

value  attained  by  changing  each  of  the  subelements  from  the 

2 

worst  to  the  best  plausible  performance  of  a  C  center  on  the 
J  particular  capabilities.  For  example,  which  provides  the 

greater  increase  in  the  value  of  the  ENVIRONMENT  DATA — 
increasing  the  quality  of  the  WEATHER  DATA  from  the  minimum  to 
the  maximum  of  its  plausible  range,  or  doing  the  same  for 
OBSTRUCTIONS  data?  The  relative  importances  of  the  ENVIRONMENT 
DATA  subelements  are  thus  established  by  successive  paired 
comparisons.  The  same  is  done  for  the  other  subelements. 

}  An  important  step  then  links  the  subelements.  The  most 

important  subelement  of  ENVIRONMENT  DATA  is  compared  with  the 
most  important  subelement  of  RED  DATA.  A  similar  comparison 
of  the  relative  value  of  varying  each  subelement  through  its 

♦  respective  performance  range  establishes  a  link  between  the 
importances  of  the  subelements  of  ENVIRONMENT  DATA  and  those 

of  RED  DATA.  The  relative  importances  of  all  those  subelements 
are  then  on  the  same  scale.  This  procedure  continues  moving 
1  toward  the  top  of  the  hierarchy.  Once  all  subelements  have 

been  either  directly  or  indirectly  compared  and  consequently 
established  on  the  same  rating  scale,  each  subelement  is 
assigned  a  number  between  0  and  1  (or  100%),  called  a  cumula- 

•  tive  weight.  This  is  simply  the  relative  importance  assigned 
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the  subelement,  divided  by  the  sum  of  the  relative  importances 
of  all  the  subelements  in  the  hierarchy.  The  cumulative 
weight  assigned  any  element  in  the  hierarchy  can  then  be 
established  by  simply  summing  the  cumulative  weights  of  all 
subelements  that  comprise  the  element  in  question.  These 
cumulative  weights  are  then  normalized  to  sum  1.0  (or  100%)  at 
each  level  of  the  hierarchy  to  yield  the  element  weights. 

3.2  Using  the  Hierarchical  Evaluation  Model 

2 

Using  the  hierarchical  C  INFORMATION  model  to  evaluate 
information  capabilities  of  specific  command  and  control 
centers  requires  a  certain  amount  of  tailoring.  This  tailor¬ 
ing  may  be  as  simple  as  merely  assigning  weights  to  the  ele¬ 
ments  of  the  hierarchy  in  a  way  that  reflects  the  relative 
importance  of  the  various  elements  at  the  particular  position 
in  the  command  structure  occupied  by  the  C  center  being 
evaluated;  it  may  be  as  complicated  as  further  breakdowns  of 
the  evaluation  hierarchy  to  achieve  lowest-level  elements 
which  are  specific  to  the  C  center  to  be  evaluated.  The 
simple  case  involves  using  one  of  the  procedures  discussed  in 
Section  3.1.  In  the  more  complicated  case,  a  large  amount  of 

further  modelling  is  necessary.  As  an  example,  to  adapt  the 

2 

model  to  use  for  evaluating  the  C  information  capabilities  of 

a  Carrier  Task  Force,  one  might  wish  to  include  specific 

status  information  on  the  carrier,  cruisers,  submarines, 

logistic  ship,  any  associated  aircraft,  and  so  on.  After 

these  kinds  of  information  were  attached  at  the  bottom  of  the 
2 

C  INFORMATION  hierarchy,  importance  weights  would  be  assigned 
to  the  elements  using  either  the  "bottom-up"  or  "top-down" 
approach. 

When  the  C*  INFORMATION  model  (applying  either  of  the 
tailoring  approaches  described  above)  has  been  used  to  evaluate 


23 


the  information  capabilities  of  a  number  of  C  centers  at 
various  positions  in  the  command  structure,  it  should  be 
possible  to  begin  to  extract  some  quantitatively  stated  princi¬ 
ples  about  the  importance  of  different  information  variables 

2 

as  a  function  of  the  positions  of  C  centers  in  the  structure. 

This  would  be  achieved  by  examining  the  variations  in  the 

relative  importances  assigned  to  the  elements  of  the  C 

INFORMATION  hierarchy  as  C  centers  from  different  branches 

and  levels  in  the  command  structure  are  evaluated.  The  set  of 

principles  extracted  from  these  evaluation  efforts  would  be  an 

2 

invaluable  aid  in  C  center  design,  as  they  could  be  used  not 

2 

only  to  guide  the  planning  of  new  C  centers,  but  would  also 

provide  logical  rationale  for  the  allocation  of  scarce  re- 

2 

sources  among  various  existing  C  centers. 
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